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Abstract 

We study raw coding of trajectories of a chaotic dynamical system 
by sequences of elements from a finite alphabet and show that there is 
a fundamental constraint on differences between codes corresponding 
to different trajectories of the dynamical system. 

1 Introduction 

By a raw coding of a chaotic discrete time dynamical system (T, X,B, fi) 
(defined by a measurable map T of a measurable space (X, B, fj) into itself 
with a ex-algebra of measurable sets B and a T-invariant probability mea- 
sure n), we mean a representation of trajectories {^ <x } t6Z+ of this system 
as sequences of elements from a finite alphabet A. In other words, one de- 
fines a mapping S : X — ► A, which takes points of the original phase space 
X of the dynamical system to elements of the alphabet A. This mapping 
defines a partition £ := {X\, X^, . ■ ■ , Xm} of the phase space X into disjoint 
measurable subsets Xi G B, i G {1, 2, . . . , M}, with a subsequent encoding 
of a trajectory by a sequence of numbers corresponding to elements of the 
partition which the trajectory successively visits; i.e., E(sc) := i if x G JQ. In 
some cases (if there exists a finite Markov partition; see, e.g,. PJE])) informa- 
tion about raw encoded trajectories allows one to completely reconstruct all 
topological characteristics of the system under consideration. Note however 
that, even if the existence of a finite Markov partition is proved rigorously, 
its practicable application is rather questionable due to the high instabil- 
ity of the chaotic map T. Moreover, it might happen that an approximate 
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Markov partition has even worse statistical characteristics (i.e., more differ- 
ing from the characteristics of the original system) than an "arbitrary" one 

The aim of the present paper is to demonstrate that, under a rather weak 
assumption about a deterministic dynamical system (weak mixing condi- 
tion), there is a fundamental constraint on elementwise differences between 
codes corresponding to different trajectories. Using standard definitions and 
constructions of ergodic theory, the main of which will be described in Sec- 
tion 2 and whose detailed analysis can be found, e.g., in [21 1^ i this statement 
can be formulated as follows. 

Theorem. Let a dynamical system (T, X, B, p) satisfy the weak mixing 
property. Consider a finite measurable partition £ := {X\, X2, ■ ■ ■ , Xm} 

M 

with Y\ m(-^Q) > 0- Then, for any positive integers N, L < 00 and for 

i=l 

almost every (with respect to the direct product measure p N ) collection 
x := {x\,X2, ■ ■ ■ ,xn} £ X , there exists a time moment to > such that 
E(T to+t Xi ) = E(T to+t Xj ) for all te{l,...,L}, i,j 6 {1, . . . , N}. 

In other words, all of these N codes of different trajectories simulta- 
neously contain arbitrarily long subsequences coinciding both in space and 
time. In Section 3, after the proof of this result, we discuss possible weak- 
enings of the assumptions under which it holds. 

From the point of view of numerous applications, let us mention con- 
nections of this problem to the analysis of properties of random number 
generators. Let {x\} t( -^ + , i & {1, ■ ■ ■ , N}, be ./V different sequences of pseu- 
dorandom numbers obtained from the same random number generator. We 
assume that those pseudorandom numbers belong to a finite alphabet A. 
It is desirable that, despite a proximity (ideally, coincidence) of statistical 
properties of these realizations, their pointwise differences should be as large 
as possible. The theorem shows that the pointwise differences between dif- 
ferent realizations are fundamentally constrained. Although this claim is 
somewhat unexpected, it completely agrees with well-known properties of 
Bernoulli or, more generally, Markov random sequences. Indeed, consider a 
Bernoulli random sequence over an alphabet with two elements {0, 1}, taken 
with probabilities p and q = 1—p, respectively. Consider an arbitrary finite 
sequence a over this alphabet, with K < L elements and L — K elements 
1. For any given positive integer to, the probability that a realization of this 
Bernoulli random sequence coincides with a on the time interval from to to 
to +L — 1 is p K q L ~ K > 0; it does not depend on an initial moment to- Thus, 
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for an arbitrary finite number of realizations of this Bernoulli sequence, the 
claim of the theorem holds true with probability one. One can similarly 
prove this statement for a Markov random chain with a finite number of 
states A = {1, . . . ,M} and a transition probability matrix tt satisfying the 
assumption ir* > for some ft € Z + (this is a direct analog of the weak 
mixing property for a Markov chain with a finite number of states). 

It is worth to note connections of this problem to the Ulam finite Markov 
chain approximation scheme and to the so-called Bowen specification prop- 
erty (see, e.g. [HQ) for chaotic dynamical systems. 

2 Necessary definitions and constructions 

Here we give a short description of standard definitions and constructions 
from ergodic theory which we need to prove the theorem. 
Recall that a measure [i is T -invariant if and only if 

J (p o T dfi = J (pdfj, 

for any /^-integrable function tp : X — > 1R 1 . 

A measurable function (p: X — > M 1 is called invariant with respect to a 
dynamical system (T, X, B, /i) (or simply T-invariant) if (p = <p o T almost 
everywhere with respect to the measure fi. 

A dynamical system (T, X, B, fj,) is ergodic if each T-invariant function 
is a constant /x-a.e. 

A dynamical system (T, X, B, ji) is weakly mixing if 

1 n— 1 

- V \fi(T- k A n B) - ijl(A)ll(B)\ 0, VA, BeB. 

n ^— " 1 

fc=o 

A direct product of two dynamical systems (I", X', //) and (T", X" , B", /j,") 
is a new dynamical system (T 1 ® T", A' ® X", B' ® B", /i' /i"), where the 
map V ® T" : X' ® X" X' ® X" is defined by the relation 

T'®T"(x',x") := (T'x',T"x"), 

while all other objects are standard direct product of spaces, <r-algebras, 
and measures, respectively. 

By A N we denote the iVth power of the set A, i.e., the direct product of 
N identical sets A G B, and by (T® N , X N ,B N , n N ) the direct product of iV 
identical dynamical systems (T,X,B, fj,). 
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A collection £ := {X%, X2, ■ ■ ■ , Xm} is called a measurable partition of a 
measurable space (X, £>, u) if Xj £ i3 Vz, X, nXj = Vi 7^ j, and |J Xj = X. 

i 

3 Proof of the theorem 

The proof of this result consists of two steps. First we show that a sufficient 
condition for the claim of the theorem is the ergodicity of the direct product 
of N copies of the original dynamical system. Then we demonstrate that 
the latter property follows from the conditions of the theorem. 

Denote := £ and inductively define a sequence of measurable parti- 
tions £( n ) with n £ Z + by the following relation: 

£(n+l) ._ /r(n) p j.-l£(n)_ 

It is immediate to check that the constructed collections of sets £W are 
measurable partitions of the space (X, B, u) for any positive integer n. The 
partition £( n ) is called the nth refinement of the partition £. 

By means of these partitions, for each n € Z + we define a collection of 
sets 

which are "toothed neighborhoods of the diagonal" in the direct product 
X^ (see Fig.QJ. 

Observe that the inclusion x := {x\, . . . , x^} € n N with n € ^ n -* implies 
the inclusion 

{T® N fx E (T®^)V E 
for all i € {0, 1, . . . , n}; hence, 

E(T t x i ) = E(T t x j ), Vi,j E {1,2,..., N}, t £ {0, 1, ... , n}. 

Therefore, if we prove that, for collection of points x := {x\, . . . , xjy} E 

X^, there exists a time moment to >0 such that 

(T®^)*o £ g r] N E (f^)", 

then the claim of the theorem will follow. 

Let a dynamical system (r, Y, By ,v) be ergodic. Then, for any pair 
of measurable sets A,B € i3y with u{A)v{B) > 0, there exists a positive 
integer x = >c(A,B) < 00 such that t*A Pi B ^ 0. Indeed, assume that 
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Figure 1: "Toothed neighborhoods of the diagonal" [0, l] 2 created by col- 
lections of the sets (£( n )) 2 (the boundary is indicated by solid lines) and 
^(n+i)^2 boundary is indicated by dashed lines). 

this is not true, i.e., r n A n B = for any positive integer n. Consider a 
measurable set 

:= (J r n A. 

Then vi^A^) > v(A) > and Aoo n B = 0. Therefore, the indicator 
function of a measurable set A^ of positive ^-measure is r-invariant but is 
not a constant a.e., which contradicts the ergodicity. 

Thus, it suffices to show that the dynamical system (T® N , X N , B N , fi N ) 
is ergodic. For that, we use the fact that the weak mixing property is 
preserved under the direct product of weakly mixing dynamical systems 
(see e.g. j2]). To complete the proof, its remains to note that weak mixing 
implies ergodicity. □ 

It is interesting that one cannot weaken the conditions of the theorem by 
changing the weak mixing of the original dynamical system to the ergodicity. 
The problem is that the direct product of ergodic dynamical systems need 
not also be ergodic: consider a direct product of two identical irrational unit 
circle rotations. 

On the other hand, the weak mixing condition is not necessary either. 
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Figure 2: Counterexample to the necessity of the weak mixing property. 

We shall show that, for some nonergodic dynamical systems, there exist 
partitions for which the claim of the theorem holds true. Indeed, let T be a 
mapping from the unit interval X = [0, 1] into itself defined by the relation 



The graph of this mapping is shown in Fig. [21 It is immediate to check that 
the restriction of the map T to each of the half-intervals Xl := [0, 1/2] (left) 
and Xr := [1/2,1] (right) with the normalized Lebesgue measure m is a 
weakly (and even strongly) mixing dynamical system. Thus, the Lebesgue 

invariant measure of the map T considered on the entire unit interval is not 

M 

ergodic. Consider a partition £ with \\ fJ,(Xi) > satisfying the assumption 

1=1 

that Xi := [1/2 - 2~ fc ,l/2 + 2~ fc ) for some k € Z+. Denote by £ L and 
£r the restrictions of the partition £ to the left and right half- intervals, 
respectively. The claim of the theorem is satisfied for each of the dynamical 
systems (T, Xl,B, m) and (T, Xr, B, m) equipped with the partitions £l and 
£r, respectively. Moreover, it turns out that, for the nonergodic dynamical 
system (T,X,B,m) with the partition £, the claim of the theorem holds as 
well. 



r 2x if < a; < 1/4, 

Tx:= <2x-l/2 if 1/4 < x < 3/4, 



(1) 



2x — 1 otherwise. 



6 



To check this, it is sufficient to show that, for any measurable set A C 
[0, 1]^ of positive Lebesgue measure, there exists an integer t$ such that 
the set (T® N ) to A has an intersection of positive Lebesgue measure with the 
"toothed neighborhood of the diagonal" in [0, 1]^ generated by the iVth 
power of the Lth refinement of the partition £. Observe that, by the con- 
struction, each of these refinements has an element containing an open neigh- 
borhood of the point 1/2. Denote by B 6 [0, 1]^ the Nth power of this open 
neighborhood contained in an element of the partition £( L ) . We need to show 
that 

(T m ) to AnB^0 (2) 

for some positive integer t^. 

By a quadrant, we shall call a direct product of n E {0, 1, . . . , N} copies 
of the interval Xl and N — n copies of the interval Xr taken in an arbitrary 
order. Clearly, the union of all possible quadrants coincides with [0,1]^. 
On the other hand, each of the quadrants is invariant under the map T® N . 
Moreover, the restriction of the dynamical system (T® , X , B N , // ) to 
each of the quadrants is again a direct product of mixing dynamical systems. 
Now there exists a quadrant whose intersection with the set A is of positive 
Lebesgue measure. Denote this quadrant by A and set A& := A n A and 
B/\ := BnA. Observe that, by the construction, we have m{A^)m{B^) > 0. 
Therefore, using the same argument as in the proof of the theorem, we get 

(T m ) t0 A A HB A ^0 

for some to > 0, which implies ©. 

Therefore, the claim of the theorem about the existence of arbitrarily 
long coinciding code segments takes place for this nonergodic dynamical 
system. In a sense, the element X\ of the partition ^ plays a role of a 
"bridge" between ergodic components of the nonergodic dynamical system 
(T, [0,1], B,m). 

The author thanks D. Buzzi for useful discussions. 
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